Integrating Reinforcement-Learning, Accumulator Models, and Motor-Primitives to Study Action Selection and Reaching in Monkeys
نویسندگان
چکیده
This paper presents a model of brain systems underlying reaching in monkeys based on the idea that complex behaviors are built on the basis of a repertoire of motor primitives organized around specific goals (in this case, arm’s postures). The architecture of the system is based on an actorcritic reinforcement-learning model, enhanced with an accumulator model for action selection, capable of selecting sensorimotor primitives so as to accomplish a discrimination reaching task that has been used in physiological studies of monkeys’ premotor cortex. The results show that the proposed architecture is a first important step towards the construction of a biologically plausible integrated motorprimitive based model of the hierarchical organization of mammals’ sensorimotor systems.
منابع مشابه
Integrating Reinforcement-Learning and Accumulator Models to Study Decision Making and Reaching Behaviours
This paper presents a model of organisms’ sensorimotor system based on the idea that complex behaviors are build on the basis of repertoires of sensorimotor primitives organised around specific goals (in this case, arm postures). The architecture of the model incorporates an actor-critic reinforcement learning system, enhanced with an “accumulator model” for decision making, capable of selectin...
متن کاملA Model of Reaching that Integrates Reinforcement Learning and Population Encoding of Postures
When monkeys tackle novel complex behavioral tasks by trial-anderror they select actions from repertoires of sensorimotor primitives that allow them to search solutions in a space which is coarser than the space of fine movements. Neuroscientific findings suggested that upper-limb sensorimotor primitives might be encoded, in terms of the final goal-postures they pursue, in premotor cortex. A pr...
متن کاملReinforcement Learning for Parameterized Motor Primitives [IJCNN1759]
One of the major challenges in both action generation for robotics and in the understanding of human motor control is to learn the “building blocks of movement generation”, called motor primitives. Motor primitives, as used in this paper, are parameterized control policies such as splines or nonlinear differential equations with desired attractor properties. While a lot of progress has been mad...
متن کاملRRLUFF: Ranking function based on Reinforcement Learning using User Feedback and Web Document Features
Principal aim of a search engine is to provide the sorted results according to user’s requirements. To achieve this aim, it employs ranking methods to rank the web documents based on their significance and relevance to user query. The novelty of this paper is to provide user feedback-based ranking algorithm using reinforcement learning. The proposed algorithm is called RRLUFF, in which the rank...
متن کاملReinforcement learning of motor skills with policy gradients
Autonomous learning is one of the hallmarks of human and animal behavior, and understanding the principles of learning will be crucial in order to achieve true autonomy in advanced machines like humanoid robots. In this paper, we examine learning of complex motor skills with human-like limbs. While supervised learning can offer useful tools for bootstrapping behavior, e.g., by learning from dem...
متن کامل